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A Method for Determining the Set of Winning Bids 
in a Combinatorial Auction 



Field of the Invention 

This invention relates to a method for determining the set of winning bids in a combinatorial 
auction. Two variants of the method are disclosed. The first method is preferred when the number 
of players and the number of combinations of items that are bid on by an individual player are 
relatively small. The second method is preferred when either of these values becomes large. 

Introduction to the Invention 

Auctions have been used in the sale of items for many years. Auctions provide a means of making 
scare items available to a large audience, and of ensuring that the seller receives the maximum 
revenue for the items. Many forms of auctions exist, including open-cry auctions, silent auctions, 
ascending bid auctions, and descending bid auctions. With the advent of the Internet and other 
forms of electronic communications, auctions are becoming increasingly common. 

Most auctions are for single items, or for multiple copies of the same item. Auctions for related 
items are often held simultaneously. There are numerous instances where the value (to a buyer or, 
in our terminology a player) of a set of items may not equal the sum of the value (to the player) 
of the individual items. In some cases, the value of a collection of items, such as an airline ticket, a 
hotel room, and theater tickets, may be higher than the sum of the value of the individual items. In 
this case, the items (airline ticket, hotel, theater tickets) are said to complement one another. In 
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other cases, the sum of the values of the individual items, such as theater tickets and concert 
tickets for the same time and date, may be higher than the value of the combination. In this case, 
the items are said to substitute for one another. Therefore a player, attempting to obtain a 
collection of items, or to obtain one collection from a of a set of specified collections, through 
participation in several single item auctions, is faced with a dilemma. She may bid on all the items 
in her desired collection, and obtain some, but not all, of the items in that collection. Even if the 
total amount she bids does not exceed her value for the collection, she may end up paying more 
for the items she receives than she values that subset of the collection. Similarly, if she bids for 
items that substitute for one another, such as the theater tickets and concert tickets, she may end 
up with both items, at a cost greater than her value for the pair, even if the amount she bids for 
each item does not exceed her value for that item. 

Summary of the Invention 

Therefore, it is evident that there is a need for combinatorial auctions, in which players can specify 
bids for collections of items. Combinatorial auctions are beginning to be used. In 2000, the 
Federal Communications Commission will use a combinatorial auction to sell a set of licenses. 

Unfortunately, whereas determining the winner of a single item auction is trivial, even when the 
auction is held over the Internet with thousands of participating players, determining the winner of 
a combinatorial auction, even a relatively small combinatorial auction, is far more difficult. For n 
items, there are 2" - 1 possible combinations. Of course, it is not expected that every possible 
combination will be bid on. However, the problem of finding from among a large set of bids, each 
for a different combination of items, the set of bids that includes each item at most once is known 
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to be computationally difficult That is, it is a member of a collection of problems called 
NP-complete, which means that there are no known computational methods that are guaranteed 
to solve the problem in a number of computations that is bounded by a polynomial in the size of 
the input data. In practice, exact solution methods for NP complete problems typically require 
computation resources that grow very rapidly with the problem size, rendering them impractical 
for all but the smallest instance of the problem. Michael Rothkopf provides an excellent survey of 
combinatorial auctions, including a discussion of particular forms of auctions that can be 
efficiently solved, in his paper "Computationally Manageable Combinatorial Auctions," published 
in Management Science, Vol. 44, No 8, August 1998, pp. 1131-1147. 

For combinatorial auctions, where bidding is typically either continuous or in rounds, and each 
player requires information about whether each of his bids is "currently" a winning bid, the set of 
winning bids must be computed quickly, and re-computed as new bids are added or the value bids 
are increased. We disclose two related methods for determining the set of winning bids for 
combinatorial auctions. Both methods can use a well-established technique called "integer 
programming" and standard commercial software for solving the integer program. The methods 
are novel inter alia in that they involve a new formulation technique for specifying the integer 
program to be solved, as well as new techniques for updating the formulation to reflect the 
addition of new bids or the modification of existing bids. 

Accordingly, we now disclose a method for executing a combinatorial auction, the method 
comprising the steps of: 

(1) reading input data comprising: 
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(i) items; 

(ii) players bidding on the items; 

and 

(iii) bids, where each bid specifies the player bidding, the amount bid, and the 
list of items included in the bid; 

(2) generating proposals by utilizing the input data, each said proposal comprising a 
collection of bids that can be awarded to a player participating in the auction; 

(3) selecting a set of proposals such that each item is included in at most one selected 
proposal; 

and 

(4) informing the players bidding on the items of the results in step (3). 

Preferably, step (1) comprises reading input data further including at least one type that is 
specified for each bid, and wherein step (2) proposals are limited to collections of bids from a 
player that are of the same type, and wherein step (3) the set of selected proposals is limited to 
sets that include at most one proposal for each player. 

Preferably, step (2) comprises generating all possible proposals. 

Preferably, the method comprises enabling step (3) by using an integer programming technique. 

Preferably, step (3) comprises selecting a set of proposals that maximizes the total value of the 
bids included in the selected proposals. 



YOR9-2000-0474 



The invention is illustrated in the accompanying drawing, in which: 

FIG. 1 shows a illustrative system block diagram of the total auction system; 

FIG. 2 shows a block diagram of the FIG. 1 system that can determine a winning 
combination of bids by generating all proposals and solving the resulting integer program; 

FIG. 3 shows a block diagram of the FIG. 1 system that may be used to solve large 
problems, in which a subset of proposals are generated, the linear programming relaxation of the 
resulting integer program is solved, the dual-variables produced by the linear programming 
package are used to adjust the value of the individual bids, and a proposal generator is run to 
generate a set of additional proposals that are eligible for inclusion in the winning combination; 

FIG. 4 shows a block diagram illustrating a method by which the optimality of the integer 
programming solution generated with a limited set of columns can be verified; 
and 

FIG. 5 shows a block diagram showing a a method for updating the optimization problem 
in response to changes in bid data. 

Detailed Description of the Invention 

As summarized above, we disclose a method for computing the set of winning bids for a 
combinatorial auction. We assume that all data describing the current players and bids is available 
in some electronic form. 
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Our method preferably supports two forms of combinatorial bidding, conjunctions (ands) and 
disjunctions (ors). Research in the area of combinatorial bid representation remains active. Noam 
Nisan provides a discussion of bid representations in his paper, "Bidding and Allocation in 
Combinatorial Auctions", presented at the 1999 Conference "Northwesterris Summer Workshop 
in Microeconomics." The representation we have chosen allows a player to limit his total 
liability while placing bids on an arbitrary number of arbitrary combinations. 

Each player can place an arbitrary number of bids. Each bid can contain any combination of 
items. A bid typically consists of the following data elements: player id, bid value, and items 
included in the bid. 

Each player can also specify a set of bid types, and can assign one or more type to each of his 
bids. Preference for combinations of items is expressed by placing the items in the same bid. 
Substitution of bids (that is, the desire to have one, but not both, or a pair of bids) may be 
expressed by assigning the bids containing the different items different types. A winning 
combination of bids preferably satisfies the following properties: 

(A) each item is included in only one winning bid; 

(B) all of the winning bids belonging to a player must be included in a single type. 

Furthermore, among all combinations of bids satisfying these two constraints, the winning 
combination must maximize total revenue. 
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To understand property (B), note that we allow a bid to be assigned to more than one type. If a 
player has a bid BID1 that is assigned to type TYPE1, a bid BID2 that is assigned to TYPE1 and 
to TYPE2, and a bid BID3 that is assigned to TYPE2, then a winning combination can include 
BID1 and BID2, because they both belong to TYPE1 . A winning combination could also include 
BID2 and BID3, because they both belong to TYPE2. The pair BID1 and BBD3 cannot appear in 
any winning combination because there is no type that includes both of these bids. 

Standard combinatorial auctions as described in Rothkpopf s paper correspond to the case where 
each player assigns all of his bids the same type. Exclusive-or auctions, where each player is 
allowed to win only one combination, correspond to the case where each player assigns each bid 
a unique type. 

We note that this specification can easily be converted to the case where each bid is allowed to be 
assigned to only one type, through the use of duplicate bids. In the example above, BID2 would 
be submitted twice by the player, once assigned TYPE1 and once assigned TYPE2. Allowing 
multiple types to be assigned to a bid may allow for more compact user interfaces. However our 
methods are not limited to the case where multiple bid types exist, or to the case where a bid is 
assigned to multiple types. 

We first present a straight forward integer programming formulation of the winning bid selection 
program. This formulation is an extension, incorporating the type constraint, of the formulation 
given by Rothkopf. 
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Let / denote the set of items, P denote the set of players, and B denote the set of bids. For each 
k g B let Sk^I denote the set of items in the bid, v k > 0 denote the value of the bid, and p(k) e P 
denote the player. We let T denote the set of bid types, and for each player p e P and each type 
/ g T we let B p j denote the set of bids of type t made by player p. Note that, as remarked 
above, for a pair of types t 1 * f, and a player p the sets B Pjt and B p j need not be disjoint (that is, 
a bid made by a player can be of more than one type), but that for a pair of players p 1 ±p the sets 
of bids submitted by the players B Pft and 5 p '/are disjoint. That is, each bid is associated with one 
or more types, but with only one player. 

To designate whether a bid j is included in the winning combination of bids, we use decision 
variables x ; , each of which must take either the value 0 (indicating that the bid j is not in the 
winning combination) or the value 1 (indicating that the bid j is in the winning combination). We 
also introduce additional 0-1 variables to indicate which type of bid is selected for each player. 
That is for each peP and / e 7 we let y Ptt be 1 if all selected bids of player p are of type /, and 
0 otherwise. 

The set of winning bids can be determined by solving the following integer program: 



Max VjXj 

jeB 



Subject to Xj < 1 



for all / g / 



0) 



for all p e P 



(2) 



xj- Z y P ,t<o 



for ally" e J 



(3) 
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x,e{0,l} 
^re{0,l} 



foraUyeJ (4) 
forallpePand/eT (5) 



Constraint (1) says that each item is in at most one winning bid. If it is required that each item be 
in exactly one winning bid (that is, that all of the items be sold) then the inequality should be 
changed to an equality. In this case, if there is an item for which no bids are submitted, the integer 
program may be infeasible. To prevent infeasibility and to also represent a minimum value for 
each item, one can include a dummy bid for each individual item. Constraint (2) says that at most 
one type of bids is selected for each player, and constraint (3) says that if a bid is selected, then 
for that player one of the types assigned to that bid has been selected. Constraints (4) and (5) 
enforce integrality on the decision variables. If each player uses only one type of bids, then the y 
variables for that player are not required and constraints (2), (3) and (5) are deleted. 
Similarly, if for player /?, each type includes at most one bid and each bid has a unique type, then 
the y variables for player p are not required. We use B p to designate the bids from player /?, 
delete constraint (3) for player p and replace constraint (2) for player p by the following 
constraint: 



The integer program (1)- (5) is easy to formulate from the auction data. Any integer 
programming solver (such as the OSL product from IBM or the CPLEX product from ILOG) can 
be used to solve problems of this form. However, the computation time and the amount of 
computer memory required to solve even moderate sized auctions with this formulation may be 
excessive. 



1 



(2') 
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We have developed a new formulation for the combinatorial auction problem. This formulation 
has the advantage that for small to moderate sized problems, much less computation time and 
computer memory is required to solve the problem. It has the further advantage that for large 
problems, it is typically not necessary to specify the full optimization problem in order to find the 
winning combination. A small subset of the problem is specified, it's linear programming (LP) 
relaxation (defined below) is solved (by well known, efficient computer programs), and the 
solution of the LP is used to determine which additional parts of the formulation are required. 
These parts are generated and the revised (slightly larger) LP is solved. This process (solve LP, 
generate more of the problem) is repeated until it can be mathematically proven that no additional 
parts of the problem need to be specified. The resulting formulation, which is typically much 
smaller than the full problem) is then solved by using commercial software packages for integer 
programming problems. We have evaluated this approach on sample data sets and have verified 
that it requires far less computer time and memory that the direct formulation that has been 
previously published. 

Rather than consider each bid individually, and use a number of constraints to indicate which 
combinations of bids can be selected simultaneously, we consider, for each player, the 
combinations of that player's bids that can be simultaneously accepted. Requirement (A) says 
that the bids belonging to a player that can be included in a winning combination can have no 
items in common. Requirement (B) says that the bids belonging to a player that can be included in 
a winning combination must all be included in a single type. It is straightforward to generate all 
possible combinations of bids belonging to a single player that can be included in a winning 
combination of bids. We call such combinations proposals. 
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Various methods can be used to generate the set of valid proposals. If ^contains only a few 
bids, an enumeration and elimination process is very fast. For each peP and / e T y enumerate all 
subsets of B Pft . From this collection of sets of bids, eliminate all sets C such that there exists 
jj e C with SjDSf * 0. Denote the collection of remaining sets of bid by 0 Ptt . If, on the other 
hand, B Pft contains many bids, then the following algorithm can be used to construct O pJ . We 
may assume, by relabeling as necessary, that the bids in B pJ are labeled 1, 2, 3, n. For each 
positive integer k = 1 , 2, . . w, let , denote the collection of subsets of { 1 , 2, 3, . . k) such that if 
exists jj' e C e O , then SjOS/ = 0. Note that 0 Ptt = {0, { 1 } } is trivial to construct, and that 
<D* , = O*;, 1 U {C(J{k} s.t.C e <&*;/ and S k n = 0 for all / e C} can be constructed from O*;, 1 
by copying O*} 1 and determining whether k can be added to each element of Oj^", 1 . 

If C e® P ,t, then the entire collection of bids in C can be in a winning combination of bids, 
because by construction, the bids all belong to a single type, and each item is contained in at most 
one bid. We call each such set C a proposal, because it represents a "proposed" set of bids to be 
awarded to a player. The amount that player p would pay for the proposal C is denoted wc and 
equal to the sum of the value of the bids in C, given by wq = £/ e c Vj. 

If the sets <D Af are computed for each player p and type /, then the winning combination of bids 
can be determined by selecting at most one proposal for each player, and determining that each 
item is in at most one selected combination. 
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We let O p = UteT O p> , be the proposals for player p s P and we let O = Upep, «=r O p> , be the set of 
all proposals. For each CeOwe use 0-1 decision variables zc which indicates whether the 
proposal C is selected (zc = 1) or not (zc = 0). We include constraints that allow only one 
proposal to be selected from each player. However, since the type restrictions are satisfied by all 
of the generated proposals, we do not need to include constraints to enforce this restriction. 
Although each proposal is generated so that each item is contained in at most one bid in that 
proposal, proposals from different players may include the same items. Therefore we require a 
constraint that ensures that the winning combination of proposals includes each item at most once. 
We let Sc be the set of items in the bids in proposal C, that is, Sc = Ujtec <S*. 

The set of winning bids can be determined by solving the following integer program: 
Max 2 wczc 

Ce<D 

Subject to 2 *c<l for all psP (6) 

Hz c <l for all/ el (7) 

CeO 

ieS c 

r c e{0,l} for all CeO (8) 

Constraint (6) says that at most one proposal from each player is in the winning combination. 
Constraint (7) says that each item is in at most one selected proposal. If each item must be sold, 
then the inequality in (7) should be changed to an equality. To prevent infeasibility, and to also 
represent a minimum value for each item, one can include a dummy player and a dummy proposal 
for each individual item. Constraints (8) enforces integrality on the decision variables. Although 
this formulation may potentially have far more decision variables than the original formulation, 
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our computational experience with this new formulation indicates that for moderate size problems 
it can be solved with less computation and less computer memory than the amount required for 
the original formulation. This faster computation time is due in part to the fact that all of the 
constraints have the same structure (sum of a set of variables is less than or equal to 1), and that 
the variables partition naturally in to sets of variables associated with each player. This partition, 
into so-called "special ordered sets" can be taken advantage of in commercial integer 
programming software. 

We can write the integer programming formulation in standard notation by constructing a matrix 

A which has a row for each player peP,a, row for each item / € /, and a column for each 

proposal C € O. In the row corresponding to player p the matrix element in column C, denoted 

a Pt c, is set equal to 1 if C e Oc and is set equal to 0 otherwise. In the row corresponding to item 

/ the matrix element in column C, denoted a,,c, is set equal to 1 if i e Sc and is set equal to 0 

otherwise. The matrix A has relatively few rows, one for each item and one for each player, but 

can, for auctions in which each player bids on many different combinations of items, have a large 

number of columns. We let w be the row vector of proposal values, and let e be a column vector 

of l's. In this standard notation, the integer program is written as 

Maxwz 
Subject to Az<e 
ze{0,l}* 

In addition to computation speed for moderate sized problems, this new formulation has a second 
advantage. For very large problems, with many items and many bidders, "column generation 
techniques" which have been used in the Operations Research profession for several decades, can 
be effectively applied. For details on the column generation technique, see Optimization Theory 
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for Large Systems, Leon S. Lasdon, 1970, MacMillan Publishing, pp, 146-148. In brief, column 
generation is used to solve mathematical optimization problems, including integer programming 
problems, when the number of columns in the constraint matrix is very large. When the constraint 
matrix A of a linear programming or integer programming problem has a very large number of 
columns it is possible to solve the problem by considering only a subset of columns, solving the 
"restricted problem" that contains only those columns, using the dual variables corresponding to 
the linear programming solution (which are produced by most commercial linear programming 
software) to adjust the prices of the remaining columns, and to determine which of the remaining 
columns can, if added to the smaller problem, result in an improvement in the objective function. 
If no columns can possibly improve the objective function, then the current solution is optimal and 
the remaining columns do not need to be considered. Otherwise some of the columns that can 
improve the objective function are added to the formulation, resulting in a somewhat larger (but 
typically still tractable) restricted problem. This process is repeated as long as columns that can 
improve the objection function can be found. The proof that column generation techniques 
produce optimal solutions is based on the concept of linear programming duality, which is 
covered in most linear programming text books and is not discussed here. 

It is important to note that the column generation approach works even when the columns of the 
matrix are not explicitly given, so long as the set of columns has a well defined structure and new 
columns can be easily identified. For our formulation, columns correspond to proposals, which 
have a well defined structure. Furthermore, the dual variables associated with the item constraints 
(8) can be easily used to adjust the bid values, and the dual variables associated with the player 
constraints can be used to determine a threshold on the adjusted value of a proposal. Proposals 
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are added to the restricted problem only if their adjusted value exceeds the threshold for the 
corresponding player. 



Detailed Description of a Preferred Embodiment of the Invention 

Referring to the drawing, aAd more particularly to FIG. 1, there is shown a schematic diagram 
(10-28) of a computer implemented system for a combinatorial auction. One or more players 
participate in the auction./Two or more items are being auctioned. Each player uses a computer 
interface to interact witly the auction. Each player can enter bids, and each player is informed, 
through the interface of the status of his or her bids. The status of a bed is "SELECTED" if the 
bid is in the current set of winning bids. Having a bid "SELECTED" is the combinatorial 
equivalent of having t(ne current high bid in a single item auction. That is, if no additional bids are 
entered, the "SELECTED" bids will become the "WINNING" bids. However, if additional bids 
are submitted, or if me value of an existing bid is increased, a "SELECTED" bid may become 
"UNSELECTED,'/ just as in a single item auction, a current high bid may be displaced by a higher 
bid. Each player is allowed to edit his or her own bids, although the types of edits may be 
significantly restricted by the auction rules. In general, we expect that players will be allowed to 
increase the value of their bids. They may also be allowed to delete items from a bid (without 
decreasing the b d value) and to designate additional types for a bid. In some auctions, players 
may also be allowed to withdraw bids, perhaps subject to some penalty. This invention is not 
concerned with the particular bidding rules of the auction, only with the methods and systems 
used to select the winning bids. 
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Depending on the policy of the auction, as embodied in the authorization rules, players may be 
allowed to view all bids, or to view all winning bids. Viewing all bids is analogous to an open cry 
auction. The method and system described in this invention are applicable independent of the form 
of the authorization rules. 

Bid data is maintained in a bid table, which is updated by a bid update function. The update 
function updates the bid table with information received from the players as well as with 
information received for the auction solver. 

The Auction controller determines when the auction solver needs to run by monitoring the data in 
the bid table, or by receiving messages from the bid update function. The Auction controller also 
determines whether the solver is idle. In this figure we show only a single solver. For large 
auctions, with a large number of bidders, or for auction for very high value items, it may be 
desirable to run multiple solvers. In the first case, the solver run time may be greater than the 
interval between bid activity, and running multiple solvers can give bidders faster feedback on the 
status of their bids. In the second case, multiple solvers can be used to increase the confidence 
that optimal solutions are being obtained, so that the seller's revenue is truly maximized. 

FIG. 2 (30-48) illustrates the details of the auction solver for moderate sized auctions. The details 
of the bid table are illustrated by example, although our methods can be applied to other forms of 
bid data as long as the required elements (bid id, player id, items in the bid, value of the bid, and 
(if required for the auction) types of the bid) are included. 
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The proposal generator generates all valid proposals for each player and each type. The use of 
proposal, and the constraints linking the proposals is a key novel feature of this inventions, as it is 
this feature that allows for rapid solution of large auctions. The proposals are generated using the 
method described in the introduction, or any other method for finding all disjoint subsets of a 
collection of sets, such as the method given by Tsukiyama, Ide, Ariyoshi and Shirakawa in "A 
New Algorithm for Generating all the Maximal Independent Sets" published in the Siam Journal 
on Computing, Volume 6, Number 3, September 1977, pages 505-517. This invention is not 
restricted to either of these methods for generating proposals. 

The proposals generated by the proposal generator are then used to construct a constraint matrix 
and an objective function for a 0-1 integer program. This construction, through the use of 
proposals, is a key novel element of this invention. The constraint matrix A has a row for each 
player p e P 9 a row for each item / e /, and a column for each proposal C e <D. In the row 
corresponding to player p the matrix element in column C, denoted a A c, is set equal to 1 if 
C e Oc and is set equal to 0 otherwise. In the row corresponding to itemi the matrix element in 
column C, denoted a,,c, is set equal to 1 if i e S c and is set equal to 0 otherwise. The objective 
function w specifies a value wc for each proposal CeO. The value wc is equal to the sum of the 
value of the bids in C, and is given by wc = £ 7 ec Y/. 

The integer program solver makes use of commercial software. In our implementation we used 
functions included in the IBM product "Optimization Solutions and Library" (OSL), along with 
some problem specific code to steer the optimization process. Other commercial software for 
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solving integer programs is available, and this invention is not limited to a particular choice of 
software or to a specific sequence of function calls used to invoke the selected software. 

The solution to the integer program is a set of proposals that includes at most one proposal for 
each player. Since the players interact with the auction through the use of bids, the selected 
proposals must be translated into a set of selected bids. This step is straightforward. A bid keB 
is selected if and only if there exists a selected proposal C € O such that keC. We note that in 
some implementations, proposals may be represented as sets of items rather than sets of bids (that 
is a bid is represented by the set Sc , and the set C is not stored). In this case, it is necessary to 
reconstruct the selected bids from the selected proposals. The details of this reconstruction are 
straightforward and are not given here. 

The list of winning bids is communicated to the bid data update function, which updates the bid 
status in the bid data table. If a bid is selected, its selected flag is set to 1. Otherwise, its 
selected_flag is set to 0. 

In FIG. 3 (52-68) there is shown a flow diagram of the Auction Solver that can be used for large 
auctions, when the computation time or space required for solving the full formulation is 
prohibitive. As in FIG. 2, bid data is presented to the solver in a bid data table. This bid data is 
used to generate an initial set of proposals. The initial set of proposals should, if possible include 
at least one proposal for each player and at least one proposal for each item. In general, the initial 
set of proposals should include proposals that are of high value, relative to their contents. If 
information about the relative value of each item is available, this can be used to select 
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combinations. Otherwise, one can make various estimates for the value of an item based on the 
value and number of items of each bid that contains the item. For the sake of completeness, we 
give one estimate here, but note that this invention is not limited to the use of any particular initial 
estimate of item value. For each item / € / let w, be the number of bids that contain /. If w, = 0 
then there are no bids that contain the item and clearly its value can be estimated to be 0. 
Otherwise one can estimate the value of /, denoted U\ by averaging the value per item ratio of 
the bids that contain #: 

ieS k 

Using an estimate for the value of each item, and estimating the "excess" value of a bid to be the 
value of the bid minus the sum of the estimated value of the items in the bid, we compute "excess 
values" for each bid as = v* - 7r,. Using these values, together with a greedy algorithm 
or a randomized greedy algorithm, one can quickly compute an initial set of proposals that have 
high "excess" value. If each item must be sold, then for each item select the bid containing that 
item that has highest excess value, and add the proposal consisting of only that bid to the set O of 
proposals. If at least one proposal from each player must be considered, the for each player (or 
for each player, type combination) then generate the proposal consisting of the bid from that 
player (or player, type combination) with the highest excess value and add that proposal to O. To 
generate additional high value proposals, consider only the bids with positive excess cost. For 
each player p and each type / and sort the positive excess value bids in B Ptt in order of decreasing 
excess cost, /(I), /(2), .../(w) Generate the proposal C = {/(I)} and add it to the set. For each bid 
k= 2, n if S c fl %> = 0, then set C = CU {/(#)} and add the proposal C to the set O. If 
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additional bids are required, a randomized greedy strategy, in which the bids are considered in 
other orders, or in which eligible bids are added to the proposal according to some probability 
distribution, can be used. 



Al is capable of solving inte] 



Once a sufficient number of columns have been generated, the objective functions w and the 
constraint matrix A corresponding to these proposals are constructed. The integer program is 
formulated. Instead of solving the integer program, we use commercial optimization software to 
solve only the linear programming relaxation of the integer program. This means that we relax the 
integrality constraints on tne decision variable, and instead of requiring that each decision variable 
take either the value 0 or ihe value 1, we allow any value in the range [0,1]. Linear programs are 
significantly easier to solve than integer programs. Most mathematical optimization software that 

jer programs can also be used to solve the linear program. In our 
()* implementation we use tl le linear programming solver in OSL. Although the solution returned by 
the linear programming s olver may specify fractional values for some of the decision variables, 
and thus does not correspond to s set of selected proposals, it provides valuable information n the 
form of dual variables. There is a dual variable associated with each constraint of the integer 
program. If an inequality is strictly satisfied, then the dual variable associated with that constraint 
will have the value 0. If the constraint is strictly satisfied, then the size of the dual variable gives 
some indication on the re ative importance of the constraint. In general, the larger the value of the 
dual variable, the larger t le "marginal value" of the resource represented by the corresponding 
constraint. For the constraints corresponding to item /, we can use the dual variable nt as an 
estimate of the value of tne item. Using these new estimates, we can again compute the "excess" 
value of bids. The dual variables kp associated with the players also play a role in the generation 
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of proposals. Since we can select only one proposal Iper player, and a large dual variable A,, would 
indicate that there are many "good" proposals fonthat player already being considered, we should 
give preference to players form whom the duaLvariable k p is small. Linear programming theory 
says that a proposal C for player p can increase the objective function value of the linear 
programming relaxation of the integer program if and only if 
wc- %_Ui>k p . (9) 

ieS e 

Expanding wc according to its definition, we have 

M>C- 2 Tli r= E(V*- 2 7li)- Z Vjt >k p . (10) 
ieS~ c ^ ieS k keC 

The condition for adding a proposal as written in (10) is in terms of the "excess" value of the 
bids. Determining whether such a proposal exists for a given player p and type t is equivalent to 
determining whether there is a disjoint collection of bids in the set B p>t that has total excess value 
greater than k p . Since the sets B Ptt will typically contain a fairly small number of bids, the 
existence of such a collection can be, if necessary, verified by complete enumeration of the bids 
having excess value greater than Min{X p , 0} . Various efficient search strategies can also be used, 
and in many cases, if such a collection exists it can be quickly found by applying a greedy 
algorithm. 

If a new proposal C is found, it may also be desirable to generate additional proposals that 
"complete" C, especially if some, or all of the items must be sold. Clearly, since only one proposal 
per player can be selected, the additional proposals to "complete" C should be for players other 
than the player p associated with C. Various strategies can be used to generate these additional 
proposals. A simple strategy would be to increase the excess value of bids from players other than 
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p that do not contain any items in Sc ,and then apply the usual proposal generation strategy. 
Additionally, computational experience with column generation methods for other large problems 
has taught us that it is often helpful to add randomly generated columns (in this case, proposals) 
to the restricted problem. Our invention is not restricted to any particular strategy for generating 
additional columns. 

If no proposals that satisfies (10) exists, then the current set of columns is used to formulate the 
integer program and the solution process continues as in the case of complete proposal 
enumeration. If proposals satisfying (10) are found, then the corresponding columns are added to 
the objective function w and to the constraint matrix A and the process of solving a linear 
program, adjusting the values, and searching for new proposals continues. 

This column generation approach has been successfully used to find very good solutions to a 
variety of optimization problem arising is diverse industries such as airlines and paper production. 
The application of a column generation based approach to maximizing revenue in a combinatorial 
auction is novel. 

If all possible columns (in our case, proposals) are generated, then the approach is guaranteed to 
find the mathematically proven optimal solution. If only a subset of the possible columns are 
generated, linear programming duality theory proves that the linear programming relaxation of the 
integer program is solved to optimality. That is, the inclusion of additional columns cannot 
improve the objective function value of the linear program. However, the fact that there are no 
additional columns that can improve the linear programming objective function does not imply 
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that there are no additional columns which would improve the integer programming objective 
function. Hence, although practical computational experience indicates that for very large 
auctions this approach will produce very good solutions, that is combinations of bids that either 
maximize, or almost maximize the possible revenue, within reasonable computation time and 
computer memory, there may be instances in which higher valued combinations of bids exist, but 
are not found by this approach alone. 

In many cases, such as in the early rounds of an auction, it may be sufficient to provide a near 
optimal solution. However, for the sake of completeness, we suggest several approaches to 
ensuring that the optimal integer solution is found. 

One obvious approach is to use randomization. For example, one could repeat the column 
generation based approach with several different sets of initial proposals. 

A second approach is to use branch-and-bound methods to search for additional columns that 
could contribute to the integer solution. This techniques is in many ways analogous to the 
branch-and-bound technique that is used with an integer programming solver, except that it is 
used for the purpose of identifying additional columns that should be added to the formulation. 
Typically, a column (proposal) is selected, and two linear programs are solved. In the first linear 
program, the value of the selected decision variable is set equal to 1. In the second, the value of 
the selected decision variable is set equal to zero. Most integer programming solvers facilitate the 
fixing of the value of a variable through special subroutines, and in general, if the solution of a 
linear program is known, it typically requires little computation to find the solution to the linear 
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program that results from adding an additional constraint or fixing a variable. In traditional 
branch-and bound, this process is used to find an integer solution, through a combination of 
enumeration and bounding. In a column generation scheme, once a linear program that has 
resulted from fixing one or more variables is solved, the dual variables are used in an attempt to 
generate additional columns for the original linear program. 

A third approach, illustrated in FIG. 4 (70-94) is to solve the IP associated with a set of columns, 
and then use information about that IP solution to either prove optimality of that solution (for the 
full set of columns), or to identify additional columns that should be considered. First note that if 
the solution to the linear program is itself integer, then it is clearly also the solution to the integer 
program, and represent the set of proposals that maximizes revenue. Also note that the solution 
to the linear programming relaxation will always be at least as large as the solution to the integer 
program. 

We use the following additional notation. For any matrix A, right-hand side r, and value function 
d, we let d(A y r)denote the optimal objective function value of the integer program with 
constraint matrix, matrix^, right-hand side r, and objective function d, and we let z(/l,r,</)denote 
an optimal solution of this integer program. We let d(A, r)denote the optimal objective function 
value of the linear program with constraint matrix, matrix A, right-hand side r, and value 
function d, and we let z(A,r y d)denote an optimal solution of this linear program. 
Let O' e O 0 be a set of columns in the current matrix such that the optimal integer solution takes 
the value 1 for all the columns in O' .Consider the effect of adding the constraint 
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to the linear and integer programs. Clearly the integer program optimal solution violates this 
constraint. If the linear program optimal solution also violates this constraint, then we add the 
constraint to the formulation of the linear program and resolve. If the linear programming solution 
does not violate this constraint, we consider another set O'having the desired property. 

Adding one constraint results in a slightly larger matrix that has one additional row, and a new 
right hand side. As done previously, we use the dual solution to this linear program to determine 
whether there are additional columns that should be added to the linear program. If additional 
columns are identified, we add them and repeat. We denote the resulting matrix (A 9 plus one 
additional row, plus all identified additional columns), to which no additional columns can be 
added as A 1 ,the right-hand side, which consists of the original right-hand side r and the 
additional element lO'l - 1, as r 1 , and the objective function as d l . If the linear programming 
solution d l (A l ,r l ) < d(A, r), then the integer solution z(A, r, d) is optimal, meaning that there is 
no set of additional columns that could improve the objective function. Otherwise, we either 
select a different subset O'and repeat, or solve the integer program having constraint matrix A 
right-hand side r 1 , and objective function d x to obtain another integer program solution and 
repeat. 

Adding a constraint of the form (11) above can also be used to check for the existence of a tie, 
that is two solutions which have the same revenue value. 



FIG. 5 (96-108) shows the steps that are required to update the optimization model when new 
bids are entered or existing bids are modified. In general additional bids are easy to deal with. The 
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proposal generation process can be used to determine proposals that contain the new bids. If all 
proposals are being generated, since all new proposals will contain at least one of the new bids, it 
is sufficient to generate all valid proposals that contain only new bids, and then to find all pairwise 
disjoint unions between these new (all new bid) proposals and any existing proposals for that 
player and types. In the column generation approach, new bids require no special attention, as the 
column generation procedure will identify proposals containing them. 

Edited bids require a bit more work. If the value of a bid is increased, the value of any proposals 
containing that bid must also be increased. If an item is deleted from a bid, the matrix entry 
corresponding to that item, in all proposals containing that bid, must be changed from 1 to 0, and 
in the case of complete enumeration, it is necessary to identify new proposals by checking 
whether that bid can now be added to any existing proposal. Alternatively, one could simply 
delete all proposals containing that bid, and treat the revised bid as a new bid. Similarly, if a type 
is added to a bid, new proposals that include that bid may become possible. In the column 
generation scheme, the column generator will identify these new proposals as required. In the 
complete enumeration scheme, it is sufficient to treat the new type as s new bid. 

We note that in some cases it may be desirable to delete a proposal, if one can prove that the 
proposal can never be in an optimal solution. For example, if C, Ci, andC2 are proposals from the 
same player and of the same type and Sc = Sci U Sc 2 and wc < wc x + wc 2 then proposal C will 
never be included in a revenue maximizing solution. 
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We also note that if the integer program has been pre-processed to generate cutting planes or 
other constraints that aid in the solution of the integer program, these new constraints will remain 
valid (but typically become weaker) as new columns are added. 

It is understood that the system and method of the present invention can be implemented using a 
plurality of separate dedicated or programmable integrated or other electronic circuits or devices 
(e.g., hardwired electronic or logic circuits such as discrete element circuits, or programmable 
logic devices such as PLDs, PLAs, PALs, or the like). A suitably programmed general purpose 
computer, e.g., a microprocessor, microcontroller or other processor device (CPU or MPU), 
either alone or in conjunction with one or more peripheral (e.g., integrated circuit) data and signal 
processing devices can be used to implement the invention. In general, any device or assembly of 
devices on which a finite state machine capable of implementing the flow charts shown in the 
figures can be used to enable the invention. 
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